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(57) Abstract 

Display apparatus, and methods 
for displaying images, e.g., text, on gray 
scale and color monitors (2400) are de- 
scribed. Gray scale displays imple- 
mented in accordance with the present 
invention include displays having a reso- 
lution in a first dimension, e.g., the hori- 
zontal dimension, which is several times 
the resolution in a second dimension, 
e.g., the vertical dimension. Various 
other displays (2400) of the present in- 
vention are capable of operating as both 
gray scale and color display devices. In 
one such display, the color filter used to 
implement a color portion of the display 
is omitted from another, e.g., gray scale 
portion of the same display. In such an 
embodiment, text, e.g., captions, are dis- 
played using the gray scale portion of the 
display while color images, e.g., graph- 
ics, are displayed on the color portion 
of the display. In another display of the 
present invention, a color filter (2401) 
with filter cells (2410, 2411, 2412) that 
can be switched between a color and a 
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can be switched between a color and a , . . .... ,, ^ A , 0 \ 

clear mode of operation are employed. When images, e.g., text, are to be delayed as gray scale .mages the filter cells {2410, 241 1, 2412) 
corresponding to the portion of the display (2400) to be used to display the gray scale images, are switched to the clear mode of operation 
In such an embodiment, the remaining portion or portions of the display X2400) may be used to display color images. 
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METHODS AND APPARATUS FOR DETECTING AND 
REDUCING COLOR ARTIFACTS IN IMAGES 
RELATED APPLICATIONS 

The present application is a continuation-in-part of pending U.S. Patent 
5 Application S.N. 09/168,013 titled, "METHODS AND APPARATUS FOR 
RESOLVING EDGES WITHIN A DISPLAY PIXEL", which was filed October 7, 
1998, and which is hereby expressly incorporated by reference. 
FIELD OF THE INVENTION 

The present invention relates to methods and apparatus for displaying images, 
10 and more particularly, to display methods and apparatus which utilize multiple 
displaced portions of an output device, e.g., liquid crystal display, to represent an 
image. 

BACKGROUND OF THE INVENTION 

Color display devices have become the principal display devices of choice for 
15 most computer users. The display of color on a monitor is normally achieved by 
operating the display device to emit light, e g., a combination of red, green, and blue 
light, which results in one or more colors being perceived by a human viewer. 

In cathode ray tube (CRT) display devices, the different colors of light are 
generated via the use of phosphor coatings which may be applied as dots in a sequence 
20 on the screen of the CRT. A different phosphor coating is normally used to generate 
each of the three colors, red, green, and blue resulting in repeating sequences of 
phosphor dots which, when excited by a beam of electrons, will generate the colors 
red, green and blue. 

The term pixel is commonly used to refer to one spot in, e.g., a rectangular grid 
25 of thousands of such spots. The spots are individually used by a computer to form an 
image on the display device. For a color CRT, where a single triad of red, green and 
blue phosphor dots cannot be addressed, the smallest possible pixel size will depend on 
the focus, alignment and bandwidth of the electron guns used to excite the phosphors. 
The light emitted from one or more triads of red, green and blue phosphor dots, in 
30 various arrangements known for CRT displays, tend to blend together giving, at a 
distance, the appearance of a single colored light source. 
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In color displays, the intensity of the light emitted corresponding to the additive 
primary colors, red, green and blue, can be varied to get the appearance of almost any 
desired color pixel. Adding no color, i.e., emitting no light, produces a black pixel. 
Adding 100 percent of all three colors results in white. 

5 Fig. 1 illustrates a known portable computer 100, which comprises a housing 

101, a disk drive 105, keyboard 104 and a flat panel display 102. 

Portable personal computers 100 tend to use liquid crystal displays (LCD) or 
other flat panel display devices 102, as opposed to CRT displays. This is because flat 
panel displays tend to be small and lightweight as compared to CRT displays. In 

10 addition, flat panel displays tend to consume less power than comparable sized CRT 
displays making them better suited for battery powered applications than CRT 
displays. 

As the quality of flat panel color displays continues to increase and their ^ost 
decreases, flat panel displays are beginning to replace CRT displays in desktop 
15 applications. Accordingly, flat panel displays, and LCDs in particular, are becoming 
ever more common. 

Over the years, most image processing techniques, including the generation and 
display of fonts, e.g., sets of characters, on computer screens, have been developed 
and optimized for display on CRT display devices. 

20 Unfortunately, existing text display routines fail to take into consideration the 

unique physical characteristics of flat panel display devices. These physical 
characteristics differ considerably from the characteristics of CRT devices particularly 
in regard to the physical characteristics of the RGB color light sources. 

Color LCD displays are exemplary of display devices which utilize multiple 

25 distinctly addressable elements, referred to herein as pixel sub-elements or pixel sub- 
components, to represent each pixel of an image being displayed. Normally, each pixel 
on a color LCD display is represented by a single pixel element which usually 
comprises three non-square elements, i.e., red, green and blue (RGB) pixel sub- 
components. Thus, a set of RGB pixel sub-components together make up a single 

30 pixel element. LCD displays of the known type comprise a series of RGB pixel sub- 
components which are commonly arranged to form stripes along the display. The 
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RGB stripes normally run the entire length of the display in one direction. The resulting 
RGB stripes are sometimes referred to as "RGB striping". Common LCD monitors 
used for computer applications, which are wider than they are tall, tend to have RGB 
stripes running in the vertical direction. 

5 Figure 2A illustrates a known LCD screen 200 comprising a plurality of rows 

(R1-R12) and columns (C1-C16) which may be used as the display 102. Each 
row/column intersection forms a square which represents one pixel element. Figure 2B 
illustrates the upper left hand portion of the known display 200 in greater detail. 

Note in Fig. 2B how each pixel element, e.g., the (Rl, C4) pixel element, 

10 comprises three distinct sub-element or sub-components, a red sub-component 206, 
green sub-component 207 and a blue sub-component 208. Each known pixel sub- 
component 206, 207, 208 is 1/3 or approximately 1/3 the width of a pixel while being 
equal, or approximately equal, in height to the height of a pixel. Thus, when 
combined, the three 1/3 width pixel sub-components 206, 207, 208 form a single pixel 

15 element. 

As illustrated in Fig. 2A, one known arrangement of RGB pixel sub- 
components 206, 207, 208 form what appear to be vertical color stripes down the 
display 200. Accordingly, the arrangement of 1/3 width color sub-components 206, 
207, 208, in the known manner illustrated in Figs. 2A and 2B, is sometimes called 
20 "vertical striping". 

While only 12 rows and 16 columns are shown in Fig. 2 A for purposes of 
illustration, common column x row ratios include, eg., 640x480, 800x600, and 
1024x768. Note that known display devices normally involve the display being 
arranged in landscape fashion, i.e., with the monitor being wider than it is high as 
25 illustrated in Fig. 2A, and with stripes running in the vertical direction. 

LCDs are manufactured with pixel sub-components arranged in several 
additional patterns including, e.g., zig-zags and a delta pattern common in camcorder 
view finders. While features of the present invention can be used with such pixel sub- 
component arrangements, since the RGB striping configuration is more common, the 
30 exemplary embodiments of the present invention will be explained in the context of 
using RGB striped displays. 
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Traditionally, each set of pixel sub-components for a pixel element is treated as 
a single pixel unit. Accordingly, in known systems luminous intensity values for all the 
pixel sub-components of a pixel element are generated from the same portion of an 
image. Consider for example, the image represented by the grid 220 illustrated in Fig. 

5 2C. In Fig. 2C each square represents an area of an image which is to be represented 
by a single pixel element, e.g., a red, green and blue pixel sub-component of the 
corresponding square of the grid 230. In Fig. 2C a shaded circle is used to represent a 
single image sample from which luminous intensity values are generated. Note how a 
single sample 222 of the image 220 is used in known systems to generate the luminous 

10 intensity values for each of the red, green, and blue pixel sub-components 232, 233, 
234. Thus, in known systems, the RGB pixel sub-components are generally used as a 
group to generate a single colored pixel corresponding to a single sample of the image 
to be represented. 

The light from each pixel sub-component group effectively adds together to 

15 create the effect of a single color whose hue, saturation, and intensity depends on the 
value of each of the three pixel sub-components. Say, for example, each pixel sub- 
component has a potential intensity of between € and 255. If all three pixel sub- 
components are given 255 intensity, the pixel will be perceived as being white. 
However, if all three pixel sub-components are given a value turning off each of the 

20 three pixel sub-components, the pixel will be perceived as black. By varying the 
respective intensities of each pixel sub-component, it is possible to generate millions of 
colors in between these two extremes. 

Since, in the known system a single sample is mapped to a triple of pixel sub- 
components which are each 1/3 of a pixel in width, spatial displacement of the left and 

25 right pixel sub-components occurs since the centers of these elements are 1/3 from the 
center of the sample. 

Consider for example that an image to be represented was a red cube with 
green and blue components equal to zero. As a result of the displacement between the 
sample and green image sub-component, when displayed on an LCD display of the 

30 type illustrated in Fig. 2 A, the apparent position of the cube on the display will be 
shifted 1/3 of a pixel to the left of its actual position. Similarly, a blue <;ube would 
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appear to be displaced 1/3 of a pixel to the right. Thus, known imaging techniques 

used with LCD screens can result in undesirable image displacement errors. 

Text characters represent one type of image which is particularly difficult to 

accurately display given typical flat panel display resolutions of 72 or 96 dots (pixels) 
5 per inch (dpi). Such display resolutions are far lower than the 600 dpi supported by 

most printers and the even higher resolutions found in most commercially printed text 

such as books and magazines. 

Because of the relatively low display resolution of most video display devices, 

not enough pixels are available to draw smooth character shapes, especially at common 
10 text sizes of 10, 12, and 14 point type. At such common text rendering sizes, 

gradations between different sizes and weights, e.g., the thickness, of the same 

typeface, are far coarser than their print equivalent. 

The relatively coarse size of standard pixels tends to create aliasing effects 

which give displayed type characters jagged edges. For example, the coarse size of 
15 pixels tends to result in the squaring off of serifs, the short lines or ornaments at the 

ends, e.g., bottom, of strokes which form a typeface character. This makes it difficult 

to accurately display many highly readable or ornamental typefaces which tend to use 

serifs extensively. 

Such problems are particularly noticeable in the stems, e.g., thin vertical 
20 portions, of characters. Because pixels are the minimum display unit of conventional 
monitors, it is not possible to display stems of characters using conventional techniques 
with less than one pixel stem weight. Furthermore, stem weight can only be increased 
a pixel at a time Thus, stem weights leap from one to two pixels wide. Often one 
pixel wide character stems are too light, while two pixel wide character stems are too 
25 bold. Since creating a boldface version of a typeface on a display screen for small 
characters involves going from a stem weight of one pixel to two pixels, the difference 
in weight between the two is 100%. In print, bold might typically be only 20 or 30 
percent heavier than its equivalent regular or Roman face. Generally, this "one pixel, 
two pixel" problem has been treated as an inherent characteristic of display devices 
30 which must simply be accepted. 
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Prior work in the field of displaying characters have focused, in part, on the 
development of anti-aliasing technologies designed to improve the display of 
characters on CRT displays. A commonly used anti-aliasing technique involves using 
shades of gray for pixels which include edges of the character. In effect, this smudges 
5 shapes, reducing spatial frequency of the edges but better approximating the intended 
character shapes. While known anti-aliasing techniques can significantly improve the 
quality of characters displayed on a CRT display device, many of these techniques are 
ineffective when applied to LCD display devices which differ considerably from CRT 
displays in terms of pixel sub-component arrangement. 

10 A further issue is that such anti-aliasing techniques work reasonably well on 

large sizes of text, but at the sizes most suited for human reading - typically between 8 
and 13 points - they have the effect of blurring the text. For the human leader, the 
effect is similar to trying to read with someone else's eyeglass prescription. The 
readers eye tries continually to focus on an image which is inherently unfocusable. This 

15 leads quickly to eyestrain and fatigue, making conventional anti-aliasing unsatisfactory 
in cases for sustained reading. 

While anti-aliasing techniques have helped the aliasing problem associated with 
displaying relatively low resolution representations of text, at least on CRT displays, 
the problem of pixel size and the inability to accurately display character stem widths 

20 has, prior to the present invention, been considered a fixed characteristic of display 
devices which must be tolerated. 

In view of the above, it is apparent that there is a need for new and improved 
methods and apparatus for displaying text on flat panel display devices. It is desirable 
that at least some of the new methods be suitable for use with existing display device 

25 and computers. It is also desirable that at least some methods and apparatus be 
directed to improving the quality of displayed text on new computers using, e.g., new 
display devices and/or new methods of displaying text. 

While the display of text, which is a special case of graphics, is of major 
concern in many computer applications, there is also a need for improved methods and 

30 apparatus for displaying other graphics, geometric shapes, e.g., circles, squares, etc., 
and captured images such as photographs, accurately and clearly. 
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SUMMARY OF THE PRESENT INVENTION 

The present invention is directed to methods and apparatus for displaying 
images utilizing multiple distinct portions of an output device, e.g., an LCD display, to 
represent a single pixel of an image. 
5 The inventors of the present application recognize the well-known principle 

that humans are much more sensitive to edges of luminance, where light intensity 
changes, than to edges of chrominance, where color intensity changes. This is why it is 
very difficult to read red text on a green background, for example. They also recognize 
the well-known principle that humans are not equally sensitive to the colors of red, 
10 green and blue. In fact, of 100 percent luminous intensity in a fully white pixel the red 
pixel sub-component contributes approximately 30% to the overall perceived 
luminance, green 60% and blue 10%. 

Various features of the present invention are directed to utilizing the individual 
pixel sub-components of a display as independent luminous intensity sources thereby 
15 increasing the effective resolution of a display by as much as a factor of 3 in the 
dimension perpendicular to the direction of the RGB striping. This allows for a 
significant improvement in visible resolution. 

While the methods of the present invention may result in some degradation in 
chrominance quality as compared to known display techniques, as discussed above 
20 humans are more sensitive to edges of luminance than of chrominance. Accordingly, 
the present invention can provide significant improvements in the quality of images, 
compared to known rendering techniques, even when taking into consideration the 
negative impact the techniques of the present invention may have on color quality. 

As discussed above, known monitors tend to use vertical striping. Because 
25 character stems occur in the vertical direction the ability to accurately control the 
thickness of vertical lines when rendering horizontally flowing text tends to be more 
important than the ability to control the thickness of horizontal lines. With this in 
mind, it was concluded that, at least for text applications, it is often more desirable to 
have a monitor's maximum resolution in the horizontal, as opposed to vertical 
30 direction. Accordingly, various display devices implemented in accordance with the 
present invention utilize vertical, as opposed to horizontal, RGB striping. This 
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provides such monitors, when used in accordance with the present invention, greater 
resolution in the horizontal direction than in the vertical direction. The present 
invention can however be applied similarly to monitors with horizontal RGB striping 
resulting in improved resolution in the vertical direction as compared to conventional 
5 image rendering techniques. 

In addition to new display devices which are suitable for use when treating 
pixel sub-components as independent luminous intensity sources, the present invention 
is directed to new and improved text, graphics and image rendering techniques which 
facilitate pixel sub-component use in accordance with the present invention. 

10 The display of images, including text, involves several steps including, e.g., 

image scaling, hinting and scan conversion. 

An image scaling technique of the present invention involves scaling geometric 
representations of text, in the dimension perpendicular to the direction of RGB 
striping, at a rate that is greater than the rate of scaling in the direction of RGB 

15 striping. Such a non-uniform scaling technique allows subsequent processing 
operations to take full advantage of the effective increase in resolution obtained by 
treating pixel sub-components as individual luminous intensity sources. Sealing in the 
direction perpendicular to the striping may also be made a function of one or more 
weighting factors used in a subsequent scan conversion operation. Accordingly scaling 

20 in the direction perpendicular to the striping may be many times, e.g., 10 times, the 
scaling performed in the direction of the striping. 

In addition to new scaling methods, the present invention is directed to new 
methods of performing hinting operations. These methods take into consideration 
pixel sub-component boundaries within an image, in addition to pixel boundaries 

25 considered in known hinting operations. Some hinting operations performed for use 
with display devices with vertical striping involve, as a step, aligning characters along 
pixel sub-component boundaries so that the character stem borders on, or even within, 
a red, blue or green pixel sub-component, as opposed to always between blue and red 
pixel sub-components as occurs at the whole pixel edge. 

30 Other hinting operations may be performed for use with display devices with 

horizontal striping. Such hiring operations involve as a step, aligning character bases 
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along pixel sub-component boundaries so that the character bases border on or within 
red or blue pixel sub-components, as opposed to a whole pixel edge. 

In accordance with the present invention, as part of a hinting operation the 
width of vertical and/or horizontal lines within an image may be adjusted as a function 
5 of pixel sub-component boundaries. This allows for the hinting processes to perform 
finer adjustments when distorting an image's shape than in known systems where 
hinting is performed as a function of the location of whole pixel boundaries (edges) as 
opposed to pixel sub-component boundaries. 

Scan conversion normally follows hinting. Scan conversion is the process by 
10 which geometric representations of images are converted into bitmaps. Scan 
conversion operations of the present invention involve mapping different portions of an 
image into different pixel sub-components. This differs significantly from known scan 
conversion techniques where the same portion of an image is used to determine the 
luminous intensity values to be used with each of the three pixel sub-components 
15 which represent a pixel. 

As a result of treating RGB pixel sub-components as independent luminous 
intensity sources, color fringing effects may be encountered. One feature of the 
present invention is directed to processing bitmapped images to detect undesirable 
color fringing effects. Another feature of the invention is directed to performing color 
20 processing operations on bitmapped images to lessen or compensate for undesirable 
color fringing effects. 

Other features of the present invention are directed to gray scale displays, and 
displays capable of displaying gray scale images, e.g., text, and color images. 

The present invention includes a gray scale monitor with rectangular display 
25 elements that provide a resolution in a first dimension, e.g., the horizontal dimension, 
which is a multiple of the resolution in a second dimension perpendicular to the first 
dimension, e.g., the vertical direction. In one exemplary embodiment, a gray scale 
display is provided which has 3 times the resolution in the horizontal dimension than it 
has in the vertical dimension. 
30 Displays, e.g., LCD displays, which are capable of operating as both gray scale 

and color display devices are also contemplated. In one such display, the color filter 
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used to implement a color portion of the display is omitted from a separate gray scale 
portion of the display. Text, e.g., captions, are displayed using the gray scale portion 
of the display while color images, e.g., graphics, are displayed using the color portion 
of the display. 

5 In another display of the present invention, a color filter with filter cells that 

can be switched between a color and a clear mode of operation are employed. When 
images, e.g., text, are to be displayed as gray scale images, the filter cells, 
corresponding to the portion of the display to be used to display the gray scale images, 
are switched to the clear mode of operation. In such an embodiment, the remaining 
10 portion or portions of the display may be used to display color images. 

Numerous additional features, embodiments, and advantages of the methods 
and apparatus of the present invention are set forth in the detailed description which 
follows. 

Brief Description of the Drawings 

15 Figure 1 is a diagram of a known portable. 

Figure 2A illustrates a known LCD screen. 

Figure 2B illustrates a portion of the known screen illustrated in Fig. 2A in 
greater detail than the Fig. 2A illustration. 

Figure 2C illustrates an image sampling operation performed in known systems. 
20 Figure 3 illustrates known steps involved in preparing ami storing character 

information for use in the subsequent generation and display of text. 

Figure 4 illustrates an electronic book with flat panel displays arranged in a 
portrait arrangement in accordance with one embodiment of the present invention. 

Figure 5 illustrates a computer system implemented in accordance with the 
25 present invention. 

Figure 6 illustrates image sampling performed in accordance with one 
exemplary embodiment of the present invention. 

Figure 7A illustrates a color flat panel display screen implemented in 
accordance with the present invention. 
30 Figure 7B illustrates a portion of the di splay screen of Fig. 7 A. 
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Figure 7C illustrates a display screen implemented in accordance with another 
embodiment of the present invention. 

Figure 8 illustrates various elements, e.g., routines, included in the memory of 
the computer system of Fig. 5, used for rendering text images on the computer 
5 system's display. 

Figure 9A illustrates a method of rendering text for display in accordance with 
one embodiment of the present invention. 

Figure 9B illustrates an exemplary color compensation sub-routine 813 of the 
present invention which may be used to implement the color processing/adjustment 
10 performed in step 915 of Fig. 9 A. 

Figures 9C and 9D illustrate pixel color processing sub-routines implemented in 
accordance with exemplary embodiments of the present invention. 

Figures 10A and 10B illustrate scaling operations performed in accordance 
with various exemplary embodiments of the present invention. 
15 Figures 11A and 11B illustrate hinting operations performed in accordance 

with various exemplary embodiments of the present invention. 

Figures 12A and 12B illustrate scan conversion operations performed in 
accordance with various exemplary embodiments of the present invention. 

Figure 1 3 illustrates the scan conversion process applied to the first column of 
20 image data illustrated in Fig. 12A in greater detail. 

Figure 14 illustrates a weighted scan conversion operation performed in 
accordance with one embodiment of the present invention. 

Figure 15 illustrates a high resolution representation of a character to be 
displayed on a field of pixels. 
25 Figure 16 illustrates how the character of Fig. 15 would be illustrated using 

known techniques. 

Figures 17-20 illustrate dMferent ways of illustrating the character shown in 
Fig. 1 5 in accordance with various text rendering techniques of the present invention. 

Figure 21 A illustrates the structure of a known color LCD screen. 
30 Figure 2 IB shows the known screen of Fig. 21 A as it would appear when 

viewed from the front. 
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Figure 22A illustrates the structure of a gray scale LCD implemented in 
accordance with one exemplary embodiment of the present invention. 

Figure 22B shows the screen of Fig. 22 A as it would appear when viewed from 
the front. 

5 Figure 23 A illustrates the structure of an LCD having both color and gray scale 

portions implemented in accordance with the present invention. 

Figure 23B shows the screen of Fig. 23 A as it would appear when viewed from 
the front. 

Figure 24A illustrates the structure of an LCD implemented in accordance with 
10 another embodiment of the present invention all or portions of which can be switched 
between color and gray scale modes of operation. 

Figure 24B shows the screen of Fig. 24A as it would appear when viewed from 
the front. 

Detailed Description 

15 As discussed above, the present invention is directed to methods and apparatus 

for displaying images, e.g., text and/or graphics, on display devices which are capable 
of utilizing multiple distinct sections of an output device, e.g., the pixel sub- 
components of a liquid crystal display, to represent a single pixel of an image. 

Various methods of the present invention are directed to using ^ach pixel sub- 

20 component as a separate independent luminous intensity source as opposed to treating 
the set of RGB pixel sub-components which comprise a pixel as a single luminous 
intensity unit. This allows for a display device with RGB horizontal or vertical striping 
to be treated as having an effective resolution in the dimension of the striping that is up 
to 3 times greater than in the other dimension. Various apparatus of the present 

25 invention are directed to display devices and control apparatus which take advantage 
of the ability to individually control sub-pixel components. 

Figure 4 illustrates a computerized electronic book device 400 implemented in 
accordance with one embodiment of the present invention. As illustrated in Fig. 4, the 
electronic book 400 comprises first and second display screens 402, 404 for displaying 

30 odd and even pages of a book, respectively. The electronic book 400 further 
comprises an input device, e.g., keypad or keyboard 408 and a data storage device, 
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e.g., CD disk drive 407. A hinge 406 is provided so that the electronic book 400 can 
be folded protecting the displays 402, 404 when not in use. An internal batteiy may be 
used to power the electronic book 400. Similarly, other portable computer 
embodiments of the present invention may be powered by batteries. 

5 Figure 5 and the following discussion provide a brief, general description of an 

exemplary apparatus in which at least some aspects of the present invention may be 
implemented. Various methods of the present invention will be described in the 
general context of computer-executable instructions, e.g., program modules, being 
executed by a computer device such as the electronic book 400 or a personal 

10 computer. Other aspects of the invention will be described in terms of physical 
hardware such as, e.g., display device components and display screens. 

The methods of the present invention may be effected by other apparatus than 
the specific described computer devices. Program modules may include routines, 
programs, objects, components, data structures, etc. that perform a task(s) or 

15 implement particular abstract data types. Moreover, those skilled in the art will 
appreciate that at least some aspects of the present invention may be practiced with 
other configurations, including hand-held devices, multiprocessor systems, 
microprocessor-based or programmable consumer electronics, network computers, 
minicomputers, set top boxes, mainframe computers, displays used in, e.g., 

20 automotive, aeronautical, industrial applications, and the like. At least some aspects of 
the present invention may also be practiced in distributed computing environments 
where tasks are performed by remote processing devices linked through a 
communications network. In a distributed computing environment, program modules 
may be located in local and/or remote memory storage devices. 

25 With reference to Figure 5, an exemplary apparatus 500 for implementing at 

least some aspects of the present invention includes a general purpose computing 
device, e.g., personal computer 520. The personal computer 520 may include a 
processing unit 521, a system memory 522, and a system bus 523 that couples various 
system components including the system memory 522 to the processing unit 521 . The 

30 system bus 523 may be any of several types of bus structures including a memory bus 
or memory controller, a peripheral bus, and a local bus using any of a variety of bus 
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architectures. The system memory 522 may include read only memory (ROM) 524 
and/or random access memory (RAM) 525. A basic input/output system 526 (BIOS), 
including basic routines that help to transfer information between elements within the 
personal computer 520, such as during start-up, may be stored in ROM 524. The 
5 personal computer 520 may also include a hard disk drive 527 for reading from and 
writing to a hard disk, (not shown), a magnetic disk drive 528 for reading from or 
writing to a (e.g., removable) magnetic disk 529, and an optical disk drive 530 for 
reading from or writing to a removable (magneto) optical disk 53 1 such as a compact 
disk or other (magneto) optical media. The hard disk drive 527, magnetic disk drive 

10 528, and (magneto) optical disk drive 530 may be coupled with the system bus 523 by 
a hard disk drive interface 532, a magnetic disk drive interface 533, and a (magneto) 
optical drive interface 534, respectively. The drives and their associated storage media 
provide nonvolatile storage of machine readable instructions, data structures, program 
modules and other data for the personal computer 520. Although the exemplary 

15 environment described herein employs a hard disk, a removable magnetic disk 529 and 
a removable optical disk 53 1, those skilled in the art will appreciate that other types of 
storage media, such as magnetic cassettes, flash memory cards, digital video disks, 
Bernoulli cartridges, random access memories (RAMs), read only memories <ROM), 
and the like, may be used instead of, or in addition to, the storage devices introduced 

20 above. 

A number of program modules may be stored on the hard disk 527, magnetic 
disk 529, (magneto) optical disk 531, ROM 524 or RAM 525, such as an operating 
system 535, one or more application programs 536, other program modules 537, 
and/or program data 538 for example. A user may enter commands and information 

25 into the personal computer 520 through input devices, such as a keyboard 540 and 
pointing device 542 for example. Other input devices (not shown) such as a 
microphone, joystick, game pad, satellite dish, scanner, or the like may also be 
included. These and other input devices are often connected to the processing unit 521 
through a serial port interface 546 coupled to the system bus 523. However, input 

30 devices may be connected by other interfaces, such as a parallel port, a game port or a 
universal serial bus (USB). A monitor 547 or other type of display device may also be 
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connected to the system bus 523 via an interface, such as a video adapter 548 for 
example. The apparatus 500 may be used to implement the book 400 through the 
addition of a second display device. In addition to the monitor 547, the personal 
computer 520 may include other peripheral output devices (not shown), such as 

5 speakers and printers for example. 

The personal computer 520 may operate in a networked environment which 
defines logical connections to one or more remote computers, such as a cemote 
computer 549. The remote computer 549 may be another personal computer, a server, 
a router, a network PC, a peer device or other common network node, and may 

10 include many or all of the elements described above relative to the personal computer 
520. The logical connections depicted in Fig. 5 include a local area network (LAN) 
551 and a wide area network (WAN) 552, an intranet and the Internet. 

When used in a LAN, the personal computer 520 may be connected to the 
LAN 551 through a network interface adapter (or "NIC") 553. When used in a WAN, 

15 such as the Internet, the personal computer 520 may include a modem 554 or other 
means for establishing communications over the wide area network 552. The modem 
554, which may be internal or external, may be connected to the system bus 523 via 
the serial port interface 546. In a networked environment, at least some of the 
program modules depicted relative to the personal computer 520 may be stored in the 

20 remote memory storage device. The network connections shown are exemplary and 
other means of establishing a communications link between the computers may be 
used. 

Fig. 7A illustrates a display device 600 implemented in accordance with an 
embodiment of the present invention. The display device 600 is suitable for use in, 

25 e.g., portable computers or other systems where fiat panel displays are desired. The 
display device 600 may be implemented as an LCD display. In one embodiment the 
display and control logic of the known computer 100 are replaced by the display 
device 600 and display control logic, e.g., routines, of the present invention to provide 
a portable computer with horizontal RGB striping and pixel sub-components which are 

30 used to represent different portions of an image. 
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As illustrated, the display device 600 includes 16 columns of pixel elements Cl- 
C16 and 12 rows of pixel elements R1-R12 for a display having 16x12 pixels. The 
display 600 is arranged to be wider than it is tall as is the case with most computer 
monitors. While the display 600 is limited to 16x12 pixels for purposes of illustration 

5 in the patent, it is to be understood that monitors of the type illustrated in Fig. 7A can 
have any number of vertical and horizontal pixel elements allowing for displays having, 
e.g., 640x480, 800x600, 1024x768 and 1280x1024 ratios of horizontal to vertical pixel 
elements as well as ratios resulting in square displays. 

Each pixel element of the display 600 includes 3 sub-components, a red pixel 

10 sub-component 602, a green pixel sub-component 604, and a blue pixel sub- 
component 606. In the Fig. 7A embodiment, each pixel sub-component 602, 604, 606 
has a height that is equal to, or approximately equal to, 1/3 the height of a pixel and a 
width equal to, or approximately equal to, the width of the pixel. 

In the monitor 600, the RGB pixel sub-components are arranged to form 

15 horizontal stripes. This is in contrast to the vertical striping arrangement used in the 
previously discussed monitor 200. The monitor 600 may be used, e.g., in particular 
graphics applications where, because of the application, it is desirable to have a greater 
vertical, as opposed to horizontal resolution. 

Figure 7B illustrates the upper left hand portion of the display 600 in greater 

20 detail. In Fig, 7B, the horizontal RGB striping pattern is clearly visible with the tetters 
R, G and B being used to indicate correspondingly colored pixel sub-components. 

Figure 7C illustrates another display device 700 implemented in accordance 
with the present invention. Fig. 7C illustrates the use of vertical RGB striping in a 
display device, e.g., an LCD display, having more vertical pixel elements than 

25 horizontal pixel elements. While a 12x16 display is illustrated, it is to be understood 
that the display 700 may be implemented with any number of columns/rows of pixels, 
including column/row ratios which result in square displays. 

The display device 700 is well suited where a portrait type display of 
horizontally flowing text is desired. A display device of the type illustrated in Fig. 7C 

30 may be used as the displays 402, 404 of the electronic book 400. As with the monitor 



WO 00/21067 



17 



PCT/US99/23497 



of Fig. 6, each pixel element is comprised of 3 pixel sub-components, i.e., an R, G, and 
B pixel sub-component. 

While the display 7A may be desirable for certain graphics applications, the 
accurate representation of character stems, the relatively long thin vertical portions of 

5 characters, is far more important than the representation of serifs in generating high 
quality characters. Vertical striping has the distinct advantage, when used according to 
the present invention, of allowing for stems which can be adjusted in width 1/3 of a 
pixel at a time. Thus, using a display device such as the device 200 or 700 with a 
vertical striping arrangement in conjunction with the display methods of the present 

10 invention, can provide higher quality text than the known horizontal striping 
arrangement which limits stem width adjustments to 1 pixel increments. 

Another advantage of vertical striping is that it allows for adjustments in 
character spacing in increments of less than a pixel size in width, e.g., 1/3 of a pixel 
size increments. Character spacing is a text characteristic which is important to 

15 legibility. Thus, using vertical striping can produce improved text spacing as well as 
finer stem weights. 

Figure 8 illustrates various elements, e.g., routines, included in the memory of 
the computer system of Fig. 5, used to render text images on the computer system's 
display in accordance with the present invention. 

20 As illustrated, the application routine 536, which may be, e.g., a word 

processor application, includes a text output sub-component 801. The text output 
sub-component 801 is responsible for outputting text information, as represented by 
arrow 813, to the operating system 535 for rendering on the display device 547. The 
text information includes, e.g., information identifying the characters to be rendered, 

25 the font to be used during rendering, and the point size at which the characters are to 
be rendered. 

The operating system 535 includes various components responsible for 
controlling the display of text on the display device 547. These components include 
display information 815, a display adapter 814, and a graphics display interface 802. 
30 The display information 815 includes, e.g., information on scaling to be applied during 
rendering and/or foreground/background color information. The display adapter 
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receives bitmap images from the graphics display interface 802 and generates video 
signals which are supplied to video adapter 548 for optical presentation by the display 
547. The arrow 815 represents passing of the bitmap images from the graphics display 
interface 802 to the display adapter 814. 

5 The graphics display interface 802 includes routines for processing graphics as 

well as text. Element 804 is a type rasterizer used to process text. The type easterner 
804 is responsible for processing the text information obtained from the application 
536 and generating a bitmap representation therefrom. The type rasterizer 804 
includes character data 806 and rendering and rasterization routines 807. 

10 The character data 806 may include, e.g., vector graphics, lines, points and 

curves, which provide a high resolution digital representation of one or more sets of 
characters. 

As illustrated in Fig. 3, it is known to process text characters 302 to generate 
high resolution digital representations thereof, such as the data 806, which can be 

15 stored in memory for use during text generation. Accordingly, the generation 304 and 
storage 306 of data 806, will not be discussed herein in any detail. 

The rendering and rasterization routines 807 include a scaling sub-routine SOS, 
a hinting sub-routine 810, a scan conversion sub-routine 812 and a color compensation 
subroutine 813. While performing scaling, hinting and scan conversion operations to 

20 render text images is common place, the routines and sub-routines of the present differ 
from known routines in that they take into consideration, utilize, or treat a screen's 
RGB pixel sub-components as separate luminous intensity entities which can be used 
to represent different portions of an image to be rendered. The color compensation 
sub-routine 813 is responsible for performing color compensation adjustments on the 

25 bitmap image created by the scan conversion sub-routine 812 to compensate for 
undesirable color fringing effects that may result from treating each of the three color 
sub-components of a pixel as separate luminous intensity elements. The operations 
performed by each of the sub-routines 808, 810, 812, and 813 of the present invention 
will be explained in detail below. 

30 Figure 9A illustrates the rendering and rasterization routines 807 used for 

rendering text for display in accordance with the present invention. As illustrated, the 
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routines 807 begin in step 902 wherein the routines are executed, e.g., under control of 
the operating system 535, in response to the receipt of text information from the 
application 536. In step 904 input is received by text rendering and rasterization 
routines 807. The input includes text, font, and point size information 905 obtained 

5 from the application 536. 

In addition, the input includes scaling information and/or 
foreground/background color information and pixel size information 815 obtained, 
e.g., from monitor settings stored in memory by the operating system. The input also 
includes the data 806 which includes a high resolution representation, e.g., in the form 

10 of lines, points and/or curves, of the text characters to be displayed. 

With the input received in step 904, operation proceeds to step 910 wherein the 
scaling subroutine 808 is used to perform a scaling operation. In accordance with the 
present invention non-square scaling is performed as a function of the direction and/or 
number of pixel sub-components included in each pixel element. In particular, the high 

15 resolution character data 806, e.g., the line and point representation of characters to be 
displayed as specified by the received text and font information, is scaled in the 
direction perpendicular to the striping at a greater rate than in the direction of the 
striping. This allows for subsequent image processing operations to take advantage of 
the higher degree of resolution that can be achieved by using individual pixel sub- 

20 components as independent luminous intensity sources in accordance with the present 
invention. 

Thus, when displays of the type illustrated in Fig. 7 A are used as the device 
upon which data is to be displayed, scaling is performed in the vertical direction at a 
rate that is greater than that performed in the horizontal direction. When screens with 
25 vertical striping, e.g., screens illustrated in Figs. 2 and 7C, are used, scaling is 
performed in the horizontal direction at a rate that is greater than that performed in the 
vertical direction. 

The difference in scaling between the vertical and horizontal image directions 
can vary depending on the display used and the subsequent scan conversion and hinting 
30 processes to be performed. Display information including scaling information obtained 



WO 00/21067 PCT/US99/23497 

20 

in step 904 is used in step 910 to determine the scaling to be performed in a given 
embodiment. 

In various embodiments of the present invention, scaling is performed in the 
direction perpendicular to the striping at a rate which is unrelated to the number of 

5 pixel sub-components which form each pixel. For example, in one embodiment where 
RGB pixel sub-components are used to form each pixel, scaling is performed in the 
direction perpendicular to the striping at a rate 20 times the rate at which scaling is 
performed in the direction of the striping. In most cases, the scaling of characters or 
images is, but need not be, performed in the direction perpendicular to the 

10 striping at a rate which allows further dividing the red, green and blue stripes in 
proportion to their luminous intensity contributions. 

Figure 10A illustrates a scaling operation performed on a high resolution 
representation of the letter i 1002 in anticipation of the display of the letter on a 
monitor with horizontal striping such as the one illustrated in Fig. 2A. Note that in this 

15 example scaling in the horizontal (x) direction is applied at a rate of xl while scaling in 
the vertical (Y) direction is applied at a rate of x3. This results in a scaled character 
1004 that is 3 times taller but just as wide as the original character 1002. 

Figure 10B illustrates a scaling operation performed on a high resolution 
representation of the letter i 1002 in anticipation of the display of the letter on a 

20 monitor with vertical striping such as the one illustrated in Tigs. 2 and 7C. Note that in 
this example scaling in the horizontal (X) direction is applied at a rate of x3 while 
scaling in the vertical (Y) direction is applied at a rate of xl. This results in a scaled 
character 1008 that is just as tall as the original character 1002 but three times wider. 

Scaling by other amounts is possible. For example, in cases where a weighted 

25 scan conversion operation is to be used in determining luminous intensity values for 
pixel sub-components as part of a subsequent scan conversion operation, scaling is 
performed as a function of the RGB striping and weighting used. In one exemplary 
embodiment scaling in the direction perpendicular to the RGB striping is performed at 
a rate equal to the sum of the integer weights used during the scan conversion 

30 operation. In one particular embodiment, this results in scaling in the direction 
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perpendicular to the striping at a rate of lOx while scaling is performed at a rate of lOx 
in the direction parallel to the striping. 

Referring once again to Fig. 9 A, once the scaling operation is completed in step 
910, operation proceeds to step 912 in which hinting of the scaled image is performed, 

5 e.g., by executing the hinting sub-routine 810. The term grid-fitting is sometimes used 
to describe the hinting process. 

Hinting operations are illustrated in Figs. 1 1 A and 1 IB. Fig. 1 1 A illustrates the 
hinting of the scaled character 1004 which is intended to be displayed on a monitor 
with horizontal striping. Fig. 1 IB illustrates the hinting of the scaled character 1008 

10 which is intended to be displayed on a monitor with vertical striping. 

Hinting involves the alignment of a scaled character, e.g., the character 1004, 
1008 within a grid 1102, 1104 that is used as part of a subsequent scan conversion 
operation. It also involves the distorting of image outlines so that the image better 
conforms to the shape of the grid. The grid is determined as a function of the physical 

15 size of a display device's pixel elements. 

Unlike the prior art which failed to take into consideration pixel sub-component 
boundaries during hinting, the present invention treats pixel sub-component boundaries 
as boundaries along which characters can and should be aligned x>r boundaries to which 
the outline of a character should be adjusted. 

20 Hinting, implemented in accordance with the present invention as a function of 

pixel sub-component boundaries, can be used to reduce color distortions, eg., color 
artifacts, that may be introduced as the result of treating each of the different color 
pixel sub-components as an independent luminous intensity source. In addition to the 
luminous intensity that is controlled, each pixel sub-component has a hue and a 

25 saturation that are normally constants determined by a color filter incorporated into the 
color display. When the luminous intensity of a sub-pixel is varied, the overall tx>lor of 
the pixel is also varied. To the extent that these color variations introduced by treating 
pixel sub-components as independent luminous sources, attract the attention of the 
human eye, they become artifacts that can distract from the function of the display 

30 which is to accurately recreate images for the human eye. It is desirable that artifacts 
that are likely to distract be avoided or minimized. 
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Adjusting the placement of an edge, e.g., as part of the hinting process, can 
have a significant effect in terms of reducing or eliminating color artifacts. For 
frequently used individual images, e.g., characters, edge placement information can be 
determined by a skilled typographer and stored in memory as part of the font 

5 information used for character generation. During the hinting operation, such specific 
character placement information, when available, is utilized to determine appropriate 
character placement during the hinting process. Images for which specific placement 
information is not stored may be aligned with various pixel and pixel sub-component 
boundaries according to stored, generally applicable hinting rules. 

10 The hinting process of the present invention involves aligning the scaled 

representation of a character within the grid, e g., along or within pixel and pixel sub- 
component boundaries in a manner intended to optimize the accurate display of the 
character using the available pixel sub-components. In many cases, this involves 
aligning the left edge of a character stem with a left pixel or pixel sub-component 

15 boundary and aligning the bottom of the character's base along a pixel component or 
sub-component boundary. 

Experimental results have shown that in the case of vertical striping, characters 
with stems aligned so that the character stem has a blue or green left edge generally 
tend to be more legible than characters with stems aligned to have a red left edge. 

20 Accordingly, in at least some embodiments, during hinting of characters to be 
displayed on a screen with vertical striping, blue or green left edges for stems are 
favored over red left edges as part of the hinting process. 

In the case of horizontal striping, characters aligned so that the bottom of the 
character base has a red or blue bottom edge generally tend to be more legible than 

25 characters with bases aligned to have a green bottom edge. Accordingly, during 
hinting of characters to be displayed on a screen with horizontal striping, in at least 
some embodiments, red or blue bottom edges are favored over green bottom edges as 
part of the hinting process. 

Figure 1 1 A illustrates the application of a hinting operation to the scaled image 

30 1 104. As part of the hinting process, the scaled image 1 104 is placed on a grid 1 102 
and its position and outline are adjusted to better conform to the grid shape and to 
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achieve a desired degree of character spacing. The letters "G.P." in Figs. 1 1 A and 1 IB 
indicate the grid placement step while the term hinting is used to indicate the outline 
adjustment and character spacing portions of the hinting process. 

Note that in Fig. 1 1 A where the image 1004 is hinted for display on a screen 
5 having horizontal striping, the scaled image 1004 is positioned along the R/G pixel 
sub-component boundary so that the base of the character 1004 has a red bottom edge. 
In addition, the image's outline is adjusted so that rectangular portions of the image 
adjoin pixel sub-component boundaries. This results in the hinted image 1014. The 
distance between the character image and left and right side bearing points (not shown) 
10 used for determining character position and spacing on the screen are also adjusted as 
a function of pixel sub-component boundaries. Thus, in various embodiments of the 
present invention, character spacing is controlled to a distance corresponding to the 
width of a pixel sub-component, e.g., 1/3 of a pixel width. 

In Fig. 11B where the image 1008 is hinted for display on a screen having 
15 vertical striping, the scaled image 1008 is positioned along the R/G pixel sub- 
component boundary so that the left edge of the stem of the hinted character 1018 has 
a green left edge. The shape of the character is also adjusted as well as the position of 
the character on the grid. Character spacing adjustments are also made. 

Once the hinting process is completed in step 912, operation proceeds to step 
20 914 wherein a scan conversion operation is performed in accordance with the present 
invention, e.g., by executing the scan conversion sub-routine 812. 

Scan conversion involves the conversion of the scaled geometry representing a 
character into a bitmap image. Conventional scan conversion operations treat pixels as 
individual units into which a corresponding portion of the scaled image .can be mapped. 
25 Accordingly, in the case of conventional scan conversion operations, the same portion 
of an image is used to determine the luminous intensity values to be used with each of 
the RGB pixel sub-components of a pixel element into which a portion of the scaled 
image is mapped. Fig. 2C is exemplary of a known scan conversion process which 
involves sampling an image to be represented as a bitmap and generating luminous 
30 intensity values from the sampled values. 
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In accordance with the present invention, the RGB pixel sub-components of a 
pixel are treated as independent luminous intensity elements. Accordingly, ^ach pixel 
sub-component is treated as a separate luminous intensity component into which a 
separate portion of the scaled image can be mapped. Thus, the present invention 

5 allows different portions of a scaled image to be mapped into different pixel sub- 
components providing for a higher degree of resolution than is possible with the 
known scan conversion techniques. That is, in various embodiments, different portions 
of the scaled image are used to independently determine the luminous intensity values 
to be used with each pixel sub-component. 

10 Fig. 6 illustrates an exemplary scan conversion implemented in accordance with 

one embodiment of the present invention. In the illustrated embodiment, separate 
image samples 622, 623, 624 of the image represented by the grid 620 are used to 
generate the red, green and blue intensity values associated with corresponding 
portions 632, 633, 634 of the bitmap image 630 being generated. In the Fig. 6 

15 example, image samples for red and blue are displaced -1/3 and +1/3 of a pixel width in 
distance from the green sample, respectively. Thus, the displacement problem 
encountered with the known sampling/image representation method illustrated in Fig. 
2C is avoided. 

In the examples illustrated in the figures, white is used to indicate pixel sub- 
20 components which are "turned on" in the bitmap image generated by the scan 
conversion operation. Pixel sub-components which are not white are "turned off'. 

In the case of black text "on" implies that the intensity value associated with 
the pixel sub-component is controlled so that the pixel sub-component does not output 
light. Assuming a white background pixel, sub-components which are not "on" would 
25 be assigned intensity values which would cause them to output their full light output. 

In the case where foreground and background colors are used "on" means that 
a pixel sub-component is assigned a value which would produce the specified 
foreground color if all three pixel sub-components were used to generate the 
foreground color. Pixel sub-components which are not "on" arc assigned values which 
30 would produce the specified background color if all three pixel sub-components were 
used to generate the background color. 
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A first technique for determining if a pixel sub-component should be turned 
"on" during scaling is to determine if the center of the scaled image segment, 
represented by a portion of the scaling grid, being mapped into the pixel sub- 
component is within the scaled representation of the image to be displayed. For 

5 example, in Fig. 12 A, when the center of grid segment 1020 was inside the image 
1004, the pixel sub-component CI, R5 would be turned on. Another technique is to 
determine if 50% or more of the scaled image segment being mapped into the pixel 
sub-component is occupied by the image to be displayed. If it is, then the pixel sub- 
component is turned "on". For example, when the scaled image segment represented 

10 by grid segment 1202 is occupied at least 50% by the image 1O04, then the 
corresponding pixel sub-component CI, R5 is turned on. In the Fig. 12A, 12B, 13 and 
14 examples which are discussed below, the first technique of determining when to 
turn a pixel sub-component on is employed. 

Fig. 12A illustrates a scan conversion operation performed on the hinted image 

15 1004 for display on a display device with horizontal striping. The scan conversion 
operation results in the bitmap image 1202. Note how each pixel sub-component of 
bitmap image columns C1-C4 is determined from a different segment of the 
corresponding columns of the scaled hinted image 1004. Note also how the bitmap 
image 1204, comprises a 2/3 pixel height base aligned along a green/blue pixel 

20 boundary and a dot that is 2/3 of a pixel in height. Known text imaging techniques 
would have resulted in a less accurate image having a base a full pixel high and a dot 
which was a full pixel in size. 

Fig. 12B illustrates a scan conversion operation performed on the hinted image 
1008 for display on a display device with vertical striping. The scan conversion 

25 operation results in the bitmap image 1203. Note how each pixel sub-component of 
bitmap image columns C1-C4 is determined from a different segment of the 
corresponding columns of the scaled hinted image 1008. Note also how the bitmap 
image 1208, comprises a 2/3 pixel width stem with a left edge aligned along a 
red/green pixel boundary. Notice also that a dot that is 2/3 of a pixel in width is used. 

30 Known text imaging techniques would have resulted in a less accurate image having a 
stem a full pixel wide and a dot a full pixel in size. 
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Figure 13 illustrates the scan conversion processes performed to the first 
column of the scaled image 1004, shown in Fig. 12 A, in greater detail. In the 
illustrated scan conversion process, one segment of the scaled image 1004 is used to 
control the luminous intensity value associated with each pixel sub-component. This 
5 results in each pixel sub-component being controlled by the same sfee portion of the 
scaled image 1004. 

Weighting may be applied during the scan conversion operation. When 
weighting is applied, different size regions of the scaled image may be used to 
determine whether a particular pixel sub-component should be turned on or off or to a 

10 value in between (as in the case of gray scaling). Application of weighting in this 
manner represents an anti-aliasing filtering operation which is performed in the 
direction perpendicular to the direction of the RGB striping. 

As discussed above, humans perceive light intensity from different color light 
sources at different rates. Green contributes approximately 60%, red approximately 

15 30% and blue approximately 10% to the perceived luminance of a white pixel which 
results from having the red, green and blue pixel sub-components set to their maximum 
luminous intensity output. 

In accordance with one embodiment of the present invention, weighting is used 
during scan conversion so that 60% of the scaled image area that is mapped into a 

20 pixel is used to determine the luminous intensity of the green pixel sub-component, a 
separate 30% of the scaled image area that is mapped into the same pixel is used to 
determine the luminous intensity of the red pixel sub-component, and a separate 10% 
of the scaled image area that is mapped into the same pixel is used to determine the 
luminous intensity of the blue pixel sub-component. 

25 In one particular embodiment of the present invention, during the scaling 

operation, the image is scaled in the direction perpendicular to the striping at a rate 
which is ten times the rate of scaling in the direction of the striping. This is done to 
facilitate a weighted scan conversion operation. After hinting, the scaled image is then 
processed during scan conversion using a weighted scan conversion operation, e.g., of 

30 the type described above. 
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Fig. 1 4 illustrates performing a weighted scan conversion operation on the first 
column 1 400 of a scaled hinted version of the image 1O02 which has been scaled by a 
factor of 10 in the vertical direction and a factor of one in the horizontal direction. In 
Fig 14, the portion of the hinted image which corresponds to a single pixel comprises 
5 10 segments. In accordance with the weighted scaling technique discussed above, the 
first three segments or each pixel area of the scaled image are used to determine the 
luminous intensity value of a red pixel sub-component corresponding to a pixel in the 
bitmap image 1402. The next six segments of each pixel area of the scaled image 1400 
are used to determine the luminous intensity value of a green pixel sub-component 
10 corresponding to the same pixel in the bitmap image 1402. This leaves the last 
segment of each pixel area of the scaled image 1400 for use in determining the 
luminous intensity value of the blue pixel sub-component. 

As illustrated in Fig. 14, this process results in the blue pixel sub-component 
being turned "on" in column 1, row 4 and the red pixel sub-component being turned 
15 "on" in column 1, row 5 of the bitmap image 1402 with the remaining pixel sub- 
components of column 1 being turned "off\ 

Generally, the scan conversion process of the present invention has been 
described in terms of turning a pixel sub-component "on" or "off'. 

Various embodiments of the present invention, particularly well suited for use 
20 with, e.g., graphics images, involve the use of gray scale techniques. In such 
embodiments, as with the embodiments discussed above, the scan conversion operation 
involves independently mapping portions of the scaled hinted image into corresponding 
pixel sub-components to form a bitmap image. However, in gray scale embodiments, 
the intensity value assigned to a pixel sub-component is determined as a function of the 
25 portion of the scaled image area being mapped into the pixel sub-component that is 
occupied by the scaled image to be displayed. For example, if, a pixel sub-component 
can be assigned an intensity value between 0 and 255, 0 being effectively off and 255 
being fiill intensity, a scaled image segment (grid segment) that was 50% occupied by 
the image to be displayed would result in a pixel sub-component being assigned an 
30 intensity value of 128 as a result of mapping the scaled image segment into a 
corresponding pixel sub-component. In accordance with the present invention, the 
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neighboring pixel sub-component of the same pixel would then have its intensity value 
independently determined as a function of another portion, e.g., segment, of the scaled 
image. 

Once the bitmap representation of the text to be displayed is generated in step 
5 914 of Fig. 9 A it may be output to the display adapter or processed further to perform 
color processing operations and/or color adjustments to enhance image quality. 

While humans are much more sensitive to luminance edges as opposed to 
image color (chrominance) edges, treating the RGB pixel sub-components as 
independent luminous intensity elements for purposes of image rendering can result in 
10 undesired color fringing effects. If, for instance, you remove red from an RGB set, a 
color fringing effect of cyan, the additive of green and blue, is likely to result. 

As discussed above, color artifacts may result from treating the different color 
pixel sub-components of a pixel as independent luminous intensity sources. Some of 
these color artifacts may remain after hinting. In fact, hints that improve the color of 
15 one edge of an image may degrade the color of another edge within the same image, 
e.g., character. 

It is desirable that color artifacts which distract, e.g., attract the attention of the 
human eye to an undesirable degree, be detected and suppressed to a degree that they 
no longer distract. Since color sensitivity varies dramatically from person to person 

20 color artifacts which may be distracting to one person may not be distracting to 
another. Accordingly, from an implementation standpoint, it is useful to focus on 
suppressing or eliminating color artifacts which are likely to distract a large percentage 
of the population. Empirical studies conducted by various named inventors of the 
present application have indicated that color artifacts which are most likely to be 

25 noticed are those which 1) are bright and 2) differ substantially in hue from the 
foreground color, the background color, and the colors that can be created by mixing 
the two. 

As will be discussed below, adjusting the luminous intensity of pixel sub- 
components of distracting pixels may involve (1) subtracting some luminous intensity 
30 from bright pixel sub-components and/or (2) adding some luminous intensity, e.g., the 
amount that was subtracted in (1), to an adjacent, different colored pixel sub- 
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component, e.g., a neighboring pixel sub-component of the same pixel. Performing 
steps (1) and/or (2) in accordance with the color compensation techniques of the 
present invention reduces color artifacts and thus color distractions. However, such 
color processing may have the unwanted side effect of degrading a desired image edge. 
5 However, in most cases it has been found that it is possible to reduce color artifacts to 
a level where they no longer distract and still provide improved image quality as 
compared to the known approach where pixel sub-components are not treated as 
independent luminous intensity sources. 

In the Fig. 9 A embodiment, the bitmap generated in step 914 is supplied to the 
10 color processing/adjustment step 915. In this step, image processing is performed to 
reduce and/or eliminate distracting color artifacts resulting from treating the pixel sub- 
components as independent luminous intensity sources. Various techniques may be 
used to identify, reduce and/or eliminate distracting color artifacts. 

In one specific embodiment, portions of an image are examined to determine 
15 how far away from the desired foreground color the bitmap image has strayed. If 
portions of the bitmap image have strayed more than a pre-selected amount from the 
desired foreground color, adjustments in the intensity values of pixel sub-components 
are applied until the image portions are brought within an acceptable range of an 
average between the foreground and background colors. 
20 In one particular embodiment, where vertical striping is used, image edges are 

checked for red fringing effects. These result from the red luminous intensity value of 
a pixel element being much higher than the green luminous intensity value for the same 
pixel element. Such a condition can produce a noticeable red color fringing effect on 
vertical stems of characters. 
25 In the exemplary embodiment, image edge pixels are individually examined. A 

red/green difference intensity value is determined and compared to a threshold value 
which is used to determine the need for a color adjustment. If the determined 
red/green difference intensity exceeds the threshold value, the red and/or green values 
are scaled to reduce the red fringing effect. Appropriate threshold and scaling values 
30 can be empirically determined- 
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Cyan color fringing effects, resulting from a low red luminous intensity value 
compared to the green and blue luminous intensity values may be detected and 
compensated for by using similar thresholding and luminous intensity scaling 
techniques to those discussed above with regard to compensating for red fringing 
5 effects. 

Fig. 9B illustrates an exemplary color compensation sub-routine 813 that is 
used, in various exemplary embodiments in conjunction with a pixel color processing 
sub-routine, e.g., the sub-routine 970 of Fig. 9C or the sub-routine 990 of Fig. 9D, to 
perform the color processing/adjustment operation of step 915. 

10 Color processing and adjustment is performed, as required, by the sub-routine 

813 on a per pixel processing basis. The sub-routine 813 starts in step 950 wherein the 
sub-routine is executed by the CPU 521. From step 950 operation proceeds to step 
952 wherein information identifying the foreground and background colors to be used, 
e.g., for text rendering, are accessed. This may involve accessing color information 

15 stored by the operating system in, e.g., the memory 535. 

In the next step, step 953, the overall luminous intensity of both a foreground 
colored pixel and a background colored pixel is determined. In one embodiment, for 
both the foreground and background colored pixels, this involves summing the red 
luminance value multiplied by a weighting factor of .3, the green luminance value by a 

20 weighting factor of .6, and the blue luminance value by a weighting factor of .1 as 
follows: 

overall luminous intensity of a pixel = .3R + 6G + IB, 

where R, G and B are the luminance intensity values of the corresponding pixel 
whose overall luminous intensity is being determined. The determined overall 
25 luminous intensity values of the background and the foreground colored pixels are 
used, at least in one embodiment, by a pixel color processing sub-routine as will be 
discussed below. 

In step 954, the bitmap image 951, e.g., the bitmap image previously generated 
in step 914, is received for processing. The bitmap image 951 comprises a total of N 
30 pixels, i.e., pixel 1 to pixel N. 
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From step 954 operation proceeds to step 956 wherein the CURRENT PIXEL 
is set equal to the first of the N image pixels. The label CURRENT PIXEL indicates 
which one of the N pixels of image 951 is being processed at any given time. 

Operation proceeds from step 956 to step 957 where a call is made to a pixel 
5 color processing sub-routine, e.g., either the sub-routine 970 of Fig. 9C or the sub- 
routine 990 of Fig. 9D. 

The pixel color processing sub-routines 970, 990 will be discussed in detail 
below with regard to Figs. 9C and 9D. Generally, the called pixel color processing 
sub-routine is responsible for determining if the luminous intensity values of the 
10 CURRENT PIXEL should be adjusted to reduce or eliminate color artifacts and to 
make such adjustments as required. If the pixel color processing sub-routine 
determines that no changes are to be made to the luminance intensity values of the 
CURRENT PIXEL'S pixel sub-components, operation proceeds to step 964 via a 
return from the called sub-routine, with the luminance intensity values of the 
15 CURRENT PIXEL'S pixel sub-components unaltered. However, if the called sub- 
routine determines that one or more of the luminance intensity values of the 
CURRENT PIXEL'S pixel sub-components should be changed to reduce or eliminate 
distracting color distortions, e.g., artifacts, one or more of the luminance intensity 
values of the CURRENT PIXEL'S pixel sub-components return from the sub-routine 
20 with an adjusted value. 

The remaining steps of the color compensation sub-routine serve to insure that 
each of the N pixels in the received bitmap image are processed by one of the pixel 
color processing sub-routines 970, 990. 

With each return from a call to the pixel color processing sub-routine in 957, 
25 operation proceeds to step 964 where a determination is made as to whether or not 
there are any more pixels in the received image to process. This may be determined by 
determining if the CURRENT PIXEt is the Nth pixel. If, in step 964 it is determined 
that additional pixels still need to be processed, operation proceeds to step 966 
wherein the CURRENT PIXEL is set equal to the next one of the N pixels. From step 
30 966 operation proceeds once again to step 957 wherein the pixel color processing sub- 
routine is called once again. 
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If, however, in step 964 it is determined that all the pixels of the received image 
have been processed, operation proceeds to step 967 wherein the processed bitmap is 
output by the color compensation sub-routine. The processed bitmap includes the 
luminance intensity values which were modified by the calls to the pixel color 
processing sub-routine. 

With the output of the processed bitmap, operation of the color compensation 
sub-routine 813 is stopped in step 968 pending the restarting of the sub-routine, e.g., 
to process another bitmapped image 95 1 . 

The first pixel color processing sub-routine 970 works particularly well with 
black and white images, e.g., black text on a white background. The sub-routine 970 
does not use the overall luminous intensity values of foreground and background 
colored pixels. Accordingly, step 953 of the color compensation sub-routine can be 
omitted or skipped when using the pixel color processing sub-routine 957. 

White is the sum of all three pixel color components, e.g., red, green and blue. 
Bright color artifacts, in a black on white embodiment, are those colors which result 
from summing the full light output of any two of the three pixel eolor components, 
e.g., yellow is the sum of red and green, magenta is the sum of red and blue, and <^an 
is the sum of green and blue. Because the blue sub-pixel has only 1/3 the potential 
luminous intensity of the red, and only 1/6* that of the green pixel subcomponents, a 
blue pixel sub-component has little effect in trading luminous intensity with a bright red 
or green pixel sub-component. For this reason, in the exemplary 9C embodiment, 
potential artifacts resulting from blue various intensity values are ignored. 

The processing implemented in sub-routine 970 serves to identify pixels which 
are likely to distract as those for which one of the red or green pixel sub-components 
are bright and the other is not. 

Suppression of the color artifact is achieved in the sub-routine 970 by 
decreasing the luminance intensity value of the brighter of the red or green pixel sub- 
components and increasing the luminance intensity value of the dimmer of the red or 
green pixel sub-components. 
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The processing performed on the R G and B luminous intensity values of a 
CURRENT PIXEL, performed by sub-routine 970, may be expressed in pseudo code 
as follows: 

THRESHOLD THEN. 
Rcp [ (Rcp ' G CP ) x RF] / 10 
G C p { (Rcp - G cp ) x RF] / 10 

luminance intensity value of the CURRENT 
PIXEL'S red pixel sub-component which can be 
any integer value in the range of 0 to 255; 
luminance intensity value of the CURRENT 
PIXEL'S red pixel sub-component which can be 
any integer value in the range of 0 to 255; 
luminance intensity value of the CURRENT 
PIXEL'S red pixel sub-component which can be 
any integer value in the range of 0 to 255; 
luminance intensity value of the CURRENT 
PIXEL'S green pixel sub-component which can 
be any integer value in the range of 0 to 255; 
RF is a red factor, e.g., 4; 
GF is a green factor, e.g., 6; and 

THRESHOLD is an empirically determined threshold value, 
e.g., 50. 

Referring now to Fig. 9C it can be seen that the pixel color processing sub- 
routine 970 begins with start step 972 wherein the routine is called for processing the 
CURRENT PIXEL'S red and green luminance intensity values which can be any 
integer value in the range of 0 to 255, respectively. Next, in step 974 the value of Rc P 
is set equal to the red pixel sub-component luminous intensity value of the pixel being 
processed and G C p is set equal to the green pixel sub-component luminous intensity 
value of the pixel being processed. Then, in step 976, a determination is made as to 
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whether | R^p - G CP | is greater than a predetermined threshold value, THRESHOLD, 
used to determine the presence of a distracting color artifact. 

If the threshold value is not exceeded in step 976, indicating that a distracting 
color artifact probably does not exist, processing returns, via RETURN step 984, to 
5 the place from which the sub-routine 970 was called without alteration of the 
CURRENT PIXEL'S luminance values. 

If, however, it is determined that the value | Kq P - G CP | exceeds the value 
THRESHOLD, indicating the probable presence of a distracting color artifact, 
operation proceeds from step 976 to step 978. In step 978 a new red pixel sub- 
10 component luminance intensity value R N is generated as a function of the original red 
and green intensity values. In particular, R N is set equal to Rqj> + [(Rep - G CP ) x 
RF/10]. Division by ten is performed to avoid the need to use a floating point value 
for RF which would then necessitate the use of floating point arithmetic. 

Next, in step 980, a new green pixel sub-component luminance intensity value 
15 G N is generated as a function of the original red and green intensity values. In 
particular, is set equal to Gcp + [(Rc P - G CP ) x RF/10]. As in the case of 
generation of the value R^, division by ten is performed to avoid the need to use a 
floating point value for RF which would require floating point arithmetic to be 
performed. 

20 While steps 978 and 980 are shown in series, it is to be understood that they 

could be performed in parallel. After generation of the new values R N and G^, the 
corresponding red and green luminance intensity values of the current pixel are 
replaced with the newly generated values. This occurs in step 982. With the 
CURRENT PIXEL'S red and green luminance intensity values updated in step 982, 

25 color correction processing with regard to the current pix^l is complete and processing 
returns, via RETURN step 984, to the place from which the sub-routine 970 was 
called. 

Operation of the second exemplary pixel color processing sub-routine 990 will 
now be described in regard to Fig. 9D. The sub-routine 990 is suitable for processing 
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pixels of images which are to be displayed using arbitrary, e.g., user selected, 
foreground and background colors. 

With arbitrary foreground and background colors, the identification and 
suppression of color artifacts resulting from treating individual pixel sub-components 
5 as independent luminous intensity sources becomes more difficult than the black and 
white case discussed above. Experiments have shown that the more saturated the 
foreground or background color, the less likely it is that a color artifact will be 
distracting. This is because saturation is actually achieved by suppressing the 
brightness of the complementary color components. This limited brightness of the 
10 complementary color components not only avoids the creation of bright distracting 
color artifacts, but makes the suppressed pixel sub-component's unsuitable for creating 
an edge with a high luminous intensity on the suppressed pixel sub-component's side. 
The net result is that for highly-saturated colors, many of the possible edge containing 
pixels gain no improvement in resolution from treating pixel sub-components as 
15 independent luminous intensity sources in accordance with the present invention. An 
example of a foreground/background color combination which can be problematic in 
the above described manner is red text on a blue background. 

On a display that places red pixel sub-components on the left and blue pixel 
sub-components on the right, a pixel rendered to display an edge with blue on the left 
20 and red on the right would be entirely black. Such a pixel would not have a color 
artifact, but also would make no contribution to the resolution of the image. In fact, a 
row of such pixels could even create the appearance of a black line, an artifact of the 
sub-pixel intensity control technique of the present invention. From an image quality 
standpoint, it is desirable that such artifacts be identified and eliminated, e.g., by 
25 utilizing traditional, whole pixel rendering techniques such as gray scaling with regard 
to pixels that would otherwise produce such artifacts. 

The color processing sub-routine 990 includes steps directed to identifying 
pixels which produce artifacts of the above described type which would benefit from 
the application of gray scaling on a whole pixel level as opposed to the generation 
30 independent luminance values for each of the pixel sub-components. It also includes 
steps which involve the application of gray scaling to determine the luminance values 
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for such pixels. In one embodiment, the gray scaling reversion is applied whenever the 
overall luminance intensity of the pixel being processed is less than the overall 
luminance intensity of both the foreground and background color. 

In addition to determining when gray scaling would enhance pixel appearance, 

5 the color processing sub-routine 990 is directed to identifying distracting color artifacts 
and performing processing to reduce or eliminate such artifacts. 

The pixel color processing sub-routine 990 begins in the start step 991 and 
proceeds from there to step 992 where a determination is made as to whether or not 
gray scaling, applied on a whole pixel basis, should be used to determine the luminance 

10 values of the CURRENT PIXEL. In step 992 a determination is made as to whether 
or not the overall luminance of the CURRENT PIXEL is less than the overall 
luminance of both a foreground color pixel and a background color pixel. If it is 
determined that the overall luminance value is less then that of a foreground and a 
background color pixel, than gray scaling will probably provide superior luminance 

15 values than those determined by the pixel sub-component method of the present 
invention. In such a case, operation proceeds from step 992 to step 997 wherein a 
pixel gray scaling operation is performed. The gray scaling operation involves two 
sub-steps, 997 A and 997B. In step 997 A the portion <P) of the current pixel which 
includes the scaled hinted image is determined. In step 997B, new red, green and blue 

20 luminance intensity values are determined for the current pixel by multiplying the 
fractional value P times the corresponding R, C and B luminance intensity values of the 
foreground color. Once the updated luminance intensity values for the CURRENT 
PIXEL are generated in step 997, processing returns, via RETURN step 984 to the 
place from which the sub-routine 970 was called. 

25 If in step 992 it was determined that gray scaling was not likely to improve the 

quality of the CURRENT PIXEL, operation proceeds to step 993. In step 993, a 
determination is made as to whether the color of the CURRENT PIXEL is different 
from both the foreground and background colors. This determination may be made by 
comparing the R, C, and B luminance intensity values of the CURRENT PIXEL to 

30 those of a foreground color pixel and a background color pixel. If in step 993 it is 
determined the color of the current pixel matches one of the foreground and 
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background color pixels, no color artifact is present and processing returns, via 
RETURN step 984, to the place from which the sub-routine 970 was called with the 
CURRENT PIXEL'S luminance intensity values being left unaltered. 

If, however, in step 993 it is determined that the color of the current pixel 
differs from the foreground and background colors, operation proceeds to step 994. In 
step 994 a determination is made as to whether or not the color of the CURRENT 
PIXEL falls within a pre-selected acceptable range of colors corresponding to 
foreground/background color mixes. If the color of the current pixel falls within the 
pre-selected range, processing returns, via RETURN step 984, to the place from which 
the sub-routine 970 was called with the CURRENT PIXEL'S luminance intensity 

values being left unaltered. 

However, if in step 994 it is determined that the color of the CURRENT 
PIXEL falls outside the pre-selected range of acceptable colors, indicating the presence 
of a distracting color artifact, operation proceeds to step 995 wherein the color of the 

15 CURRENT PIXEL is adjusted towards the range of acceptable colors. This may 
involve modifying one or more of the R, G, B luminance intensity values associated 
with the CURRENT PIXEL, e.g., by adding or subtracting from the existing values to 
move the individual value closer to those found in the pre-selected range of acceptable 
colors. Thus, at the end of step 995, the color of the CURRENT PIXEL is closer to 

20 being within, or falls within, the pre-selected acceptable range of colors corresponding 
to a mix of foreground and background colors. Once the luminance intensity values of 
the CURRENT PIXEL are updated in step 995, processing returns, via RETURN step 
984, to the place from which the sub-routine 970 was called in the above described 
manner, the luminous intensity values of pixels representing a bitmapped image may be 

25 processed and adjusted, on a pixel by pixel basis, to reduce or eliminate color 
distortions introduced into an image as the result of treating different color pixel sub- 
components as independent luminance sources. 

Figure 15 illustrates a high resolution representation of character n to be 
rendered superimposed on a grid representing an array of 12x12 pixels with horizontal 
30 striping. 
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Figure 16 illustrates how the character n illustrated in Fig. 15 would be 
rendered using conventional display techniques and full size pixel elements each 
including three pixel sub-components. Note how the full pixel size limitation results in 
relatively abrupt transitions in shape at the ridge of the letter resulting in aliasing and a 

5 relatively flat top portion. 

Figure 17 illustrates how rendering of the letter n can be improved in 
accordance with the present invention by using a 2/3 pixel height base. The base is 
formed using 2 pixel sub-components as opposed to all three pixel sub-components in 
row 10, col. 1-4 and 8-10. Note also how the ridge of the letter has been improved by 

10 providing a ridge a full pixel height in width but with each horizontal full height pixel 
element staggered by a 1/3 pixel height in the vertical direction making for a much 
more accurate and smoother ridge than that illustrated in Fig. 16. 

Figure 1 8 illustrates how the ridge of the letter n can be reduced in thickness 
from one pixel in thickness to a 2/3 pixel thickness in accordance with the present 

15 invention. 

Figure 19 illustrates how the base of the letter n can be reduced, in accordance 
with the present invention, to a minimal thickness of 1/3 that of a pixel. It also 
illustrates how portions of the ridge of the letter n can reduced to a thickness of 1/3 
that of a pixel. 

20 Figure 20 illustrates how the letter n can be illustrated, in accordance with the 

present invention, with a base and ridge having a thickness of 1/3 that of a pixel. 

While the present invention has been described largely in the context of 
rendering text, it is to be understood that the present invention can be applied to 
graphics as well to reduce aliasing and increase the effective resolution that can be 

25 achieved using striped displays such as conventional color LCD displays. In addition, 
it is to be understood that many of the techniques of the present invention can be used 
to process bitmapped images, e.g., scanned images, to prepare them for display. 

In addition, it is to be understood that the methods and apparatus of the present 
invention can be applied to grayscale monitors which, instead of using distinct RGB 

30 pixel sub-components, use multiple non-square pixel sub-components, of the same 
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color, to multiply the effective resolution in one dimension as compared to displays 
which use square pixel elements. 

Fig. 21 A illustrates a known back light color LCD 2100. The LCD display 
2100, is designed as a series of layered components. As illustrated, at the back of the 
5 display is a light source 2102 which provides light, e.g., white light, represented by the 
three arrows, to a first polarizing filter 2104. A first glass substrate layer 2106 
separates the first polarizing filter 2104 from a first layer of transparent electrodes 
2108. A layer liquid crystal material 2110 is sandwiched between the first layer of 
transparent electrodes 2108 and a second layer 2108' which includes electrodes which 
10 run perpendicular to the direction of the electrodes in the first layer. A color filter 
2112 including Red (R), Green (G), and Blue (B) filter segments, which run the 
vertical length of the display 2100, is placed in front of the second set of transparent 
electrodes 2108'. A second glass substrate 2106 separates the color filter 2112 and a 
second polarizing filter 2104' located at the front of the display 2100. 
15 Light entering the first polarizing filter 2104 exists the display 2100 after 

passing through the electrode layers 2108, 2108', liquid crystal material 2110, color 
filter 2112 and second polarizing filter 2104'. The color filter 2112 determines the 
color of light output by any particular segment of the display 2100. By adjusting the 
voltage on the electrodes 2108, 2108', the intensity of light output via any segment of 
20 the display 2 1 00 may be controlled. 

Fig. 2 IB illustrates how the known screen 21 A would appear when viewed 
from the front. Note how the R G, and B segments of the color filter 2112 form 
vertical color stripes on the display 2100. Note also how the transparent electrodes 
can be controlled to form a plurality of separately controllable screen segments 
25 represented by the rectangular boxes labeled R G, B. As with the known screen 
illustrated in Figs. 2A and 2B, each pixel of an image may comprise one R G and B 
display element to form a square pixel. 

Figs. 22A-24B illustrate displays implemented in accordance with various 
embodiments of the present invention. Components included in the displays illustrated 
30 in Figs. 22A-24B, which are the same as or similar to the components of the known 
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display 2100 are identified using the same reference numbers used in Fig. 21 A. For the 
sake of brevity, such components will not be described again. 

Fig. 22A illustrates a gray scale LCD 2200 implemented in accordance with 
one embodiment of the present invention. The display 2200 comprises a back light 

5 2102, first and second polarizing filters 2104, 2104', first and second glass substrates 
2106, 2106', and first and second transparent electrode layers 2108, 2108' which are 
arranged to form a layered structure as illustrated in Fig. 22A. Note that the display 
2200 lacks the color filter 2112 found in the known display 2100. Since the color filter 
2112 is omitted, the light output of each separately controllable display segment will 

10 generally match the color of the back light 2102, e.g., will be whke. The intensity of 
each display segment may be varied from full intensity to being fully off, e.g., by 
varying a voltage applied to electrodes 2108 and 21 08\ 

Fig. 22B illustrates how the display 2200 would appear when viewed from the 
front. Note how the display 2200 comprises a plurality of separately controllable 

15 luminous intensity sources in the form of rectangular display elements including, e.g., 
display elements 2210, 2211, 2212, each of which is the same color. Each display 
element 2210, 2210, 2213 comprises the portions of the sandwiched layers 2102, 
2104, 2106, 2108, 21 10 which correspond to the area of the individual display element 
2210, 2211, 2213. In various embodiments of the present invention, the display 

20 elements are implemented so that their size in one dimension, e.g., the vertical 
dimension, is an integer multiple of their size in the other, e.g., horizontal dimension. 

Various features of the present invention are directed to the use of adjacent 
display elements of the same color which form a display having a resolution in a first 
direction, e.g., the horizontal direction, that is a multiple of the resolution in a direction 

25 perpendicular to the first direction, e.g., the vertical direction. In the exemplary Fig. 
22B embodiment, each display element 2210, 221 1, 2212 is 3 times taller than it is 
wide. This results in a resolution in the horizontal direction that is three times the 
resolution in the vertical direction. However, non-square display elements with other 
height-width ratios are also contemplated and possible. In fact, displays with vertical 

30 resolutions that are greater than the horizontal resolutions may be implemented. In 
addition, the displays of the present invention may include any number of rows and/or 
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columns of display elements. Each display element 2210, 2211, 2212 represents a 
separately controllable luminous intensity source. 

The display 2200, is similar in construction to the display 2100, but is simpler 
to implement since the display 2200 lacks the color filter 2112 incorporated into the 
5 display 2100. While being simpler to construct than the known screen 2100, the gray 
scale display 2200 allows for the display of text and other images at a potentially 
higher resolution in one dimension than is possible using the conventional screen 2100 
where color distortions may occur when treating pixel sub-components as independent 
luminance sources. 

10 Because the display 2200 is a single color, it is particularly well suited for use 

as a gray scale monitor. Such a monitor is well suited for displaying, e.g., text in 
accordance with the present invention. 

Because each controllable display element 2210, 2211, 2200 is of the same 
color, they can be treated as individual pixels. Alternatively, multiple non-square 

15 display elements can be grouped together to form square pixels. For example, display 
elements 2210, 2211 and 2213 may be grouped together to represent a single square 
pixel. In such a case, the scaling, grid fitting and scan conversion operations 
performed as part of an image, e.g., text, rendering operation would be the same as or 
similar to the methods described above in regard to the color embodiment of the 

20 present invention, e.g., each display element of a pixel would be treated as an 
independent luminous intensity source. 

However, in the Fig. 22A embodiment all display elements, i.e., pixel sub- 
components, are of the same color. Accordingly, there is no need to use different 
weighting factors with different pixel sub-components since the pixel sub-components 

25 will contribute uniformly to the overall perceived luminance of a displayed image. In 
addition hinting and grid-fitting operations designed to align a character edge along a 
particular color boundary need not be performed since sub-pixel component color 
boundaries do not exist in the Fig. 22A embodiment. In addition, there would be no 
need for the color compensation step 915 since different color, e.g., RGB, pixel sub- 

30 components are not used. 
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Fig. 23 A illustrates a display 2300 implemented in accordance with another 
embodiment of the present invention. In the Fig. 23 A embodiment, a first, e.g., top, 
portion of the display is implemented as a gray-scale display while a second, e.g., 
bottom, portion of the display is implemented as a color display. 
5 The display 2300 comprises a back light 2102, first and second polarizing 

filters 2104, 2104', first and second glass substrates 2106, 2106', first and second 
transparent electrode layers 2108, 2108', color filter 2112 and transparent spacers 
2312 arranged to form a layered structure as illustrated in Fig. 23 A. The color filter 
2112 is positioned so that it filters the light passing through the lower portion of the 
10 screen 2300 while the clear spacers 23 12 are located at the top, e.g., gray scale portion 
of the display 2300. The spacers 2312 allow light of any color to pass through, e.g., 
they pass white light when such light is generated by the backlight 2102. The clear 
spacers 23 12 are of the same thickness as the color filter 2112. Thus, the spacers 23 12 
serve to maintain a uniform display thickness in the portions of the display where the 
15 color filter is omitted. The combination of the color filter 2112 and clear spacers 2312 
may be described as a light filter with a plurality of cells where each cell corresponds to 
an individual display element 2302, 2304, 2306 or 2308 and where «ach cell is either 
clear or colored. Accordingly, each display element 2302, 2304, 2306, 2308 
comprises the portions of the sandwiched layers 2102, 2104, 2106, 2108, 21 10 and the 
20 light filter comprising elements 2112 and 2312, which correspond to the area of the 
individual display element. 

The color filter 2112, comprises repeating R, G, and B stripes 2321, 2322, 
2323 which run in the vertical direction. The color filter 21 12 is included only in the 
lower portion of the display. Accordingly, the bottom portion of the display 2300 will 
25 support color output. The top portion of the display 2300, however, supports only a 
single color or gray scale output since different color filter strips are not employed in 
the top portion of the display 2300. The intensity of each segment of the display 2300 
may be varied from full intensity to being fully off, e.g., by varying a voltage applied to 
electrodes 2108 and 2108'. 
30 Fig. 23B illustrates how the display 2300 would appear when viewed from the 

front. Note how the display 2300 comprises a plurality of separately controllable 
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luminous intensity sources each of which is represented as a separate rectangle in Fig. 
23B. Reference numeral 2302 is used to indicate a white display element, e.g., 
luminous intensity source, while reference numerals 2304, 2306 and 2308 are used to 
indicated red, green and blue display elements respectively. Note that in Fig. 23B a 

5 single row 2301 of white display elements 2302 and two rows 2303, 2305 of colored 
display elements 2304, 2306, 2308 are illustrated. However, any combination of white 
(gray scale) and colored display elements is possible. In addition, any number of rows 
and/or columns of display elements are possible. 

While Fig. 23B illustrates a single row 2301 of gray scale pixel elements of the 

10 same color, multiple rows and/or columns of such pixel elements will normally be 
included in a display and grouped together, e.g., to support the display of text. 

The display 2300 is well suited for applications where a portion of the display 
screen is to be dedicated to the display of text while another portion is to be used, e.g., 
for color graphics. For example, a display of the present invention having a gray scale 

15 portion at the top or bottom may be used for displaying captioning information using 
the display's gray scale portion while the color portion may be used for displaying color 
images. Such a display has the advantage of providing higher resolution and/or easier 
to read text than an RGB display having display elements of the same size while still 
allowing for the display of color graphics. 

20 As discussed above, gray-scale monitors implemented in accordance with the 

present invention can produce easier to read text than RGB striped monitors having 
display elements of the same size. This is because gray scale monitors do not suffer 
from color distortions relating to treating pixel sub-components as independent 
luminous intensity sources. Many displays are used for displaying text at one time and 

25 displaying color graphics at another time. In addition, different portions of a single 
display are commonly used to display text and color graphics at the same time. The 
particular portion of the display used for text may vary depending on the amount of 
text information and/or the image being displayed along with the text. 

To support the gray scale display of text and color images in such varied 

30 applications, one embodiment of the present invention is directed to a display device 
which includes a filter having filter cells which are capable of switching between color 
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and clear modes of operation. A display 2400 implemented in accordance with such an 
exemplary embodiment of the present invention is illustrated in Figs. 24 A and 24B. 

The display 2400 comprises a back light 2102, first and second polarizing 
filters 2104, 2104 1 , first and second glass substrates 2106, 2106', first and second 

5 transparent electrode layers 2108, 2108 1 and a switchable color filter 2401 arranged to 
form a layered structure as illustrated in Fig. 22A. Note that the display 2400 is similar 
in construction to the known display 2100 with the exception of the color filter. The 
known display used a fixed striped color filter while the display 2400 of the present 
invention uses a striped switchable color filter 240 1. 

10 The color filter 2401 comprises a plurality of switchable red 2406, green 2404 

and blue 2402 filter stripes. Each filter stripe 2406, 2404, 2402 includes a plurality of 
separately controllable filter cells 2406', 2404' and 2402', respectively. Each filter cell 
corresponds to an individual display element representing, e.g., a red, green or blue 
pixel sub-component respectively, when operating in color mode and a gray scale 

15 display element, e.g., gray scale pixel or pixel sub-component, when operating in gray 
scale mode. The voltage applied to electrodes incorporated into each cell of the 
switchable color filter 2401 may be varied to change the cell from a colored to a clear 
or transparent mode of operation. Thus, the individual filter cells 2406* in stripe 2406 
may be independently controlled to operate as red or clear filter cells. In addition, the 

20 individual filter cells 2404* in stripe 2404 may be independently controlled to operate as 
green or clear filter cells. Furthermore, the individual filter cells 2402 1 in stripe 2402 
may be independently controlled to operate as blue or clear filter cells. The luminous 
intensity of each display element may be varied from full intensity to being fully off, 
e.g., by varying a voltage applied to electrodes 2108 and 2108' and/or by varying the 

25 voltage applied to electrodes included in each filter cell corresponding to a display 
element. 

Fig. 24B illustrates how the display 2400 would appear when viewed from the 
front. Note how the display 2400 comprises a plurality of separately controllable 
luminance sources in the form of display elements, e.g., display elements 2410, 2411, 
30 2412, each of which can be switched between a red, green or blue modes of operation, 
respectively, and a gray scale mode of operation. Each display element 2410, 2412, 
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2212 comprises the portions of the sandwiched layers 2102, 2104, 2106, 2108, 2401 
which correspond to the area of the individual display element 2410, 241 1, 2413. 

The display elements 2410, 241 1, 2412 are illustrated as being taller than they 
are wide in Figs. 24 A and 24B. It is to be understood that display elements of other 
5 sizes may also be employed, e.g., resulting in square display elements or display 
elements which are wider than they are tall. In addition, it is to be understood that 
while three rows and 9 columns of display elements are illustrated in Fig. 24B, it is to 
be understood that a display can be built with any number of rows and/or columns of 
display elements. 

10 An alternative to using the switchable red, green and blue filter stripes 2406, 

2404, 2402 would be to replace such switchable filter stripes with switchable yellow 
filter stripes or stripes of another, single color. Filter stripes capable of switching 
between a color, e.g., yellow, and a clear mode of operation, may be used to, e.g., 
highlight text being displayed. 

15 When using the display 2400, a determination is made at the time of rendering 

as to whether or not the image to be displayed corresponds to text or another type of 
graphic image. For portions of the display 2400 which are to be used for the display of 
text, the filter cells are set to a gray scale, e.g., clear, mode of operation. For portions 
of the display 2400 which are to be used for the display of non-text images, the filter 

20 cells are normally set to a color mode of operation. This approach allows for gray 
scale text display in accordance with the present invention while still allowing for the 
color display of images anywhere on the display device 2400. 

Setting of the filter cells' mode of operation may be achieved by sending one or 
more filter mode control signals, e.g., filter mode control commands, to a display 

25 device incorporating the display 2400. The filter mode control commands indicate the 
mode in which filter cells associated with, e.g., identified in the command, are to 
operate. The filter mode control commands are generated by the rendering and 
rasterization routines 807 as part of the text rending process, or, alternatively, by the 
video adapter 548. In one RGB embodiment, the default is to have the switchable 

30 filter cells operate in color mode and require a command to change to a clear state, 
e.g., for text rendering. In a yellow/clear embodiment, the default mode is the clear 
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mode of operation with a command being used to initiate a yellow mode of filter cell 
operation. 

A display device incorporating the display 2400 includes control logic which is 
responsive to the filter mode control commands. The control logic generates the 

5 necessary electrical signals, in response to received commands, to change the mode of 
operation of display filter cells. 

While the term "clear" has been used to describe the character of the filter cells 
2410, 241 1, 2412 when operating in gray scale mode, it is to be understood that they 
may include a slight tint of color due to difficulties in producing a perfectly clear filter 

10 that can also serve as a red, green or blue color filter. Accordingly, in some 
embodiments the filter cells 2410, 2411 and 2412 are only substantially clear when 
operating in gray-scale display mode. In any event, at least in one exemplary 
embodiment, when operating in gray-scale mode the filter cells 2410 pass red, green 
and blue light which is not the case when operating in color mode. 

15 While various methods and apparatus of the present invention have been 

described in the context of liquid crystal display devices or in the context of being used 
with liquid crystal displays, many of the methods and apparatus of the present 
invention can be used with, and improve, image quality on a number of types of output 
and display devices. 

20 For example, the scaling, scan conversion and hinting methods discussed above 

which involve treating different color pixel sub-components as independent luminous 
intensity sources, may be applied to images which are to be displayed on cathode ray 
tube (CRT) displays. 

Printers represent another class of output devices to which the scaling, hinting 

25 and scan conversion operations of the present invention may be applied. The methods 
and apparatus of the present invention are particularly well suited for use with ink jet 
and other types of printers where portions of an image are represented by displaced 
(offset) color samples printed on a fixed medium, e.g., paper. 

While liquid crystal (LDC) and other types of display devices often share 

30 certain common characteristics, e.g., the use of RGB pixel sub-components to 
represent a pixel, specific display characteristics, e.g., color filter characteristics, may 
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vary from manufacturer to manufacturer. Display, e.g., monitor, characteristics may 
also vary between different types of monitors produced by the same manufacturer. 

One embodiment of the present invention takes into consideration differences 
between different monitors by storing anti-aliasing information, e.g., weighting factor 

5 information, for specific display devices, in memory. The rasterization and rendering 
routines of the present invention utilize this display device information when available 
for the particular display device being used in a given application. Accordingly, in 
various embodiments of the present invention, anti-aliasing and gamma correction 
operations are implemented using stored filter weights and gamma values associated 

10 with individual models of display devices, e.g., LCD screens. 

Anti-aliasing operations are performed in various above described embodiments 
in one dimension through the use of different red, green and blue weights used during 
the scan conversion process. The application of anti-aliasing techniques in a second 
dimension are contemplated, and in various exemplary embodiments are employed to 

15 further enhance image quality. 

In view of the description of the invention included herein, numerous additional 
embodiments and variations on the discussed embodiments of the present invention 
will be apparent to one of ordinary skill in the art. It is to be understood that such 
embodiments do not depart from the present invention and are to be considered within 

20 the scope of the invention. 
What is claimed is: 
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1 . A method of processing at least one pixel corresponding to a portion of 
an image, the method comprising the steps of: 

receiving red and green luminance intensity values corresponding to a 
pixel to be processed; 

5 generating a red and green luminance intensity difference value from the 

received red and green luminance intensity values; 

determining if the red and green luminance intensity difference value is 
greater than a threshold value; and 

when the red and green luminance intensity difference value exceeds the 
10 threshold value, adjusting at least one of the received red and green luminance 

intensity values to decrease the difference in values between the red and green 
luminance intensity values. 

2. The method of claim 1, wherein the step of adjusting at least one of the 
received red and green luminance intensity values includes the step of subtracting a 

15 first value from the larger of the received red and green luminance intensity values. 

3. The method of claim 2, wherein the step of adjusting at least one of the 
red and green luminance intensity values further includes the step of adding a second 
value to the smaller of the received red and green luminance intensity values. 

4. The method of claim 3, wherein the first and second values are a 
20 function of the difference between the received red and green luminance values. 

5. The method of claim 3, wherein the step of generating the red and 
green luminance difference value includes the step of determining the absolute value of 
the difference between the red and green luminance intensity values. 

6. The method of claim 1, wherein the step of adjusting at least one of the 
25 received red and green luminance intensity values includes the step of adding a value to 

the smaller of the received red and green luminance intensity values. 

7. The method of claim 6, wherein said value added to the smaller of the 
received red and green luminance intensity values is a function of the difference 
between the received red and green luminance intensity values. 
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8. The method of claim 7, wherein at least the receiving, generating and 
determining steps of claim 1 are repeated for each pixel of a plurality of pixels which 
represent said image. 

9. The method of claim 1, wherein at least the receiving, generating and 
5 determining steps of claim 1 are repeated for each pixel of a plurality of pixels which 

represent said image. 

10. The method of claim 1, wherein the step of generating the red and 
green luminance difference value includes the step of determining the absolute value of 
the difference between the red and green luminance intensity values. 

10 1 1 . A computer readable medium, comprising: 

computer executable instructions for performing a pixel processing operation, 
the pixel processing operation including the steps of: 

receiving red and green luminance intensity values corresponding to a 
pixel to be processed; 

15 generating a red and green luminance intensity difference value from the 

received red and green luminance intensity values; 

determining if the red and green luminance intensity difference value is 
greater than a threshold value; and 

when the red and green luminance intensity difference value exceeds the 
20 threshold value, adjusting at least one of the received red and green luminance 

intensity values to decrease the difference in values between the red and green 
luminance intensity values. 
12. A computer system comprising: 

a display device including red, green and blue luminous intensity 
25 elements which are used to represent a pixel of an image; 

means for receiving red and green luminance intensity values 
corresponding to a pixel to be processed; 

means for generating a red and green luminance intensity difference 
value from the received red and green luminance intensity values; 
30 means for determining if the red and green luminance intensity 

difference value is greater than a threshold value; 
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means for adjusting at least one of the received red and green luminance 
intensity values to decrease the difference in values between the red and green 
luminance intensity values, when the red and green luminance intensity 
difference value exceeds the threshold value; and 
5 means for supplying adjusted luminance intensity values to the display 

device. 

13. A method of processing pixels representing an image being displayed 
using a foreground and a background color, the method comprising the steps of: 

i) receiving red, green and blue luminance intensity values 
10 corresponding to one of the pixels; 

ii) determining an overall luminous intensity of the one of the 
pixels from the received luminance intensity values; 

iii) determining if the overall luminance intensity of the one of the 
pixels is less than the overall luminance intensity of a foreground colored pixel 

15 and a background colored pixel; and 

iv) if it is determined that the overall luminance intensity of the one 
of the pixels is less than the overall luminance intensity of the foreground 
colored pixel and the background colored pixel, 

performing an image processing operation to generate a new set 
20 of red, green and blue luminance intensity values corresponding to the 

one of the pixels; and 

substituting the new set of red, green and blue luminance 
intensity values for the received set of red, green and blue luminance 
intensity values. 

25 14. The method of claim 13, further comprising the step of repeating steps 

i, ii, iii, and iv for each one of the pixels representing said image. 

15. The method of claim 14, further comprising the step of generating said 
image on a display device using the new red, green and blue luminance intensity values. 

16. The method of claim 13, wherein the step of performing an image 
30 processing operation to generate a new set of red, green and blue luminance intensity 

values includes the step of: 
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performing a gray scaling operation on the one of the pixels on a whole pixel 

basis. 

17. The method of claim 13, further comprising the step of: 
determining if the one of the pixels being processed includes a color 

artifact that is likely to be distracting; and 

if it is determined that the one of the pixels being processed includes a 
color artifact that is likely to be distracting, modifying the value of at least one 
of the received red, green and blue luminance intensity values to generate a 
new set of red, green and blue luminance intensity values. 

18. The method of claim 13, further comprising the steps of: 
determining if the overall color created by the received red, green and 

blue intensity values, is outside a range of colors corresponding to mixes of the 
foreground color and the background color. 

19. The method of claim 18, further comprising the step of adjusting at 
least one of received red, green and blue luminance intensity values, when it is 
determined that the overall color created by the received red, green and blue intensity 
values is outside said range of colors, to adjust the overall color created by the red, 
green and blue intensity values so that it is closer to a color in said range of colors. 

20. The method of claim 18, further comprising the step of adjusting at 
least one of received red, green and blue luminance intensity values, when it is 
determined that the overall color created by the received red, green and blue intensity 
values is outside said range of colors, to adjust the overall color created by the red, 
green and blue intensity values so that it corresponds to a color within said range of 
colors. 

21. A computer readable medium, comprising: 

computer executable instructions for performing a pixel processing operation 
on a pixel representing a portion of an image, the pixel processing operation including 
the steps of: 

i) receiving red, green and blue luminance intensity values 
corresponding to one of the pixels; 
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ii) determining an overall luminous intensity of the one of the 
pixels from the received luminance intensity values; 

iii) determining if the overall luminance intensity of the one of the 
pixels is less than the overall luminance intensity of a foreground colored pixel 
and a background colored pixel; and 

iv) if it is determined that the overall luminance intensity of the one 
of the pixels is less than the overall luminance intensity of the foreground 
colored pixel and the background colored pixel, 

performing an image processing operation to generate a new set 
of red, green and blue luminance intensity values corresponding to the 
one of the pixels; and 

substituting the new set of red, green and blue luminance 
intensity values for the received set of red, green and blue luminance 
intensity values. 

22. A method of processing a color pixel, the color of the pixel being a 
function of red, green and blue luminance intensity values associated with the pixel, the 
method comprising the steps of: 

comparing the color of the pixel to a range of colors corresponding to a 
pre-selected mix of foreground and background colors; and 

when it is determined that the color of the pixel being processed is 
outside said range of colors, performing a color correction operation on the 
pixel being processed. 

23. The method of claim 22, wherein the color correction operation 
includes the step of: 

adjusting at least one of a red, green and blue luminance intensity value 
associated with the pixel being processed. 

24. The method of claim 22, wherein the step of comparing the^olor of the 
pixel to a range of colors includes the step of: 

comparing the red luminance intensity value associated with the pixel 
being processed to a range of red luminance intensity values that exist between 
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the red luminance intensity value associated with the foreground color and a 
red luminance intensity value associated with the background color. 
25. The method of claim 24, wherein the step of comparing the color of the 
pixel being processed to a range of colors further includes the step of: 
5 comparing the green luminance intensity value associated with the pixel 

being processed to a range of green luminance intensity values that exist 
between the green luminance intensity value associated with the foreground 
color and a green luminance intensity value associated with the background 
color. 

0 26. The method of claim 22, wherein the step of comparing the color of the 

pixel being processed to a range of colors includes the step of: 

comparing the green luminance intensity value associated with the pixel 
being processed to a range of green luminance intensity values that exist 
between the green luminance intensity value associated with the foreground 
5 color and a green luminance intensity value associated with the background 

color. 

27. The method of claim 22, wherein the step of comparing the color of the 
pixel being processed to a range of colors includes the step of: 

comparing the blue luminance intensity value associated with the pixel 
:0 being processed to a range of blue luminance intensity values that exist between 

the blue luminance intensity value associated with the foreground color and a 
blue luminance intensity value associated with the background color. 

28. The method of claim 22, further comprising the step of: 

comparing the color of a pixel being processed to a foreground color 
15 and a background color; and 

wherein the steps of comparing the color of the pixel to a range of 
colors and performing a color correction operation are performed only when 
the color of the pixel being processed is different from the foreground and the 
background color. 

\0 29. The method of claim 23, wherein the color correction operation 

includes the step of: 
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adjusting at least two of a red, green and blue luminance intensity value 
associated with the pixel being processed. 

30. A computer readable medium, comprising: 

computer executable instructions for performing a pixel processing 
5 operation on a color pixel representing a portion of an image, the color of the 

pixel being a function of red, green and blue luminance intensity values 
associated with the pixel, the processing operation including the steps of: 

comparing the color of the pixel to a range of colors 
corresponding to a pre-selected mix of foreground and background 
10 colors; and 

when it is determined that the color of the pixel being processed 
is outside said range of colors, performing a color correction operation 
on the pixel being processed, the color correction operation involving 
the modification of at least one of the red, green and blue luminance 
15 intensity values associated with the color pixel. 

31. A method of processing a color pixel, the color of the pixel being a 
function of red, green and blue luminance intensity values associated with the pixel, the 
method comprising the steps of: 

determining if the red luminance intensity value associated with the 
20 pixel being processed falls within a range of red luminance intensity values that 

extends from a red luminance intensity value associated with a foreground 
color and ends with a red luminance intensity value associated with a 
background color; and 

when it is determined that the red luminance intensity value of the pixel 
25 being processed is outside said range of red luminance intensity values, 

adjusting the red luminance intensity value associated with the pixel being 
processed so that it is closer to or falls within said range of red luminance 
intensity values. 

32. The method of claim 31, further comprising the steps of: 

30 determining if the green luminance intensity value associated with the 

pixel being processed falls within a range of green luminance intensity values 
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that extends from a green luminance intensity value associated with a 
foreground color and ends with a green luminance intensity value associated 
with a background color; and 

when it is determined that the green luminance intensity value of the 
5 pixel being processed is outside said range of green luminance intensity values, 

adjusting the green luminance intensity value associated with the pixel being 
processed so that it is closer to or falls within said range of green luminance 
intensity values. 

33 . The method of claim 32, further comprising the steps of: 
l0 determining if the blue luminance intensity value associated with the 

pixel being processed falls within a range of blue luminance intensity values that 
extends from a blue luminance intensity value associated with a foreground 
color and ends with a blue luminance intensity value associated with a 
background color; and 

15 when it is determined that the blue luminance intensity value of the pixel 

being processed is outside said range of blue luminance intensity values, 
adjusting the blue luminance intensity value associated with the pixel being 
processed so that it is closer to or falls within said range of blue luminance 
intensity values. 

20 34. A method of processing an image including a plurality of N pixels, 

where N is an integer, the method comprising the steps of: 

comparing the color of each one of the N pixels to a color range 
corresponding to mixes of a foreground and a background display color; and 
adjusting the color of pixels which are outside said color range. 
25 35. The method of claim 34, 

wherein the color of each pixel is determined by a combination of red, 
green and blue luminance intensity values associated with the pixel, and 

wherein the step of adjusting the color of the pixels includes the step of: 
modifying at least one of the luminance intensity values 
30 associated with each pixel upon which the adjusting step is performed. 

36. The method of claim 35, further comprising the step of: 
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selecting for inclusion in the plurality of N pixels, pixels which have a 
color which is different than a foreground and a background display color, the 
selecting step being performed prior to the comparing step. 
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